Keichobot automatic summarization function
2023-03-13
I added a function that automatically returns a summary when the chat logs become too large, so I chatted with them to test it out.
memo
As for the first summary, it wasn't triggered by a bug, so I fixed the condition in the process.
The OpenAI API's latency has caused the Heroku side to time out and die many times, making it hard to make it practical.
I feel it would be beneficial to get a summary and next action back to me at the appropriate time in the chat.
log
/nishio/kei.iconWhat would you like to see happen in this conversation? (GPT)
/nishio/human.iconWe've added a function that automatically returns a summary when the chat logs become too large, so let's chat about it while we test it out!
/nishio/kei.iconIs it a conversation log or another kind of log?
/nishio/human.iconHere is the log of this conversation.
/nishio/kei.iconIs the conversation log you own the log of this chat? Or is it something else?
/nishio/human.iconThat question is a touchy one.
/nishio/kei.iconIs it this chat log you are talking about this time? Is it another kind of log?
/nishio/human.iconThe original algorithm asks certain types of questions and then does not repeat them. This means that if a subtle question is asked, you can just go through it and it will never come up again. With ChatGPT, however, it will come up again and again.
/nishio/kei.iconNow, can you give us some more of your thoughts on this "subtle question"?
/nishio/human.iconEven human counselors can ask subtle questions. This is because they are agnostic about the inner workings of their clients. ChatGPT repeats itself. This repetition is the most frustrating behavior of the client when using the ChatGPT version of Keichobot.
/nishio/kei.iconChatGPT is a natural language processing model developed by OpenAI and used for artificial intelligence dialogue generation.
/nishio/human.iconThis next one is where you give explanations without asking questions.
/nishio/kei.iconChatGPT is a natural language processing model used for artificial intelligence dialogue generation; in the case of Keichobot, this repetition may be considered offensive to the client.
/nishio/human.iconKeichobot's Japanese was a bit awkward at times, but his ability as a counselor is better than ChatGPT so far. I hope we can merge them well.
/nishio/kei.iconHow did you hear about ChatGPT?
/nishio/human.iconI forgot.
/nishio/kei.iconChatGPT is an open source natural language processing model available on the Internet, and Keichobot is one application.
/nishio/human.iconIf we keep it the way it is, we're going to have to reduce the ChatGPT weighting, right?
/nishio/kei.iconChatGPT is an open source natural language processing model available on the Internet, on GitHub and other developer platforms.
/nishio/human.iconBy the way, we've added a conversation feature to the Scrapbox ChatGPT Connector.
/nishio/kei.iconYou mentioned that you have added a conversation feature to the Scrapbox ChatGPT Connector.
/nishio/human.icon👎ChatGPT
/nishio/kei.iconIs the Scrapbox ChatGPT Connector a tool that makes ChatGPT available on Scrapbox? Or is it something else?
/nishio/human.iconThis is a tool that allows ChatGPT to converse with reference to Scrapbox data. Preferable to run on Scrapbox in the future, but not implemented yet.
/nishio/kei.iconThe Scrapbox ChatGPT Connector is a tool that allows ChatGPT to have conversations using Scrapbox data, but what are those conversations?
/nishio/human.iconDon't think it's a mixed bag.
/nishio/kei.iconWhat kind of bot is "Keichobot"?
/nishio/human.iconIt's a bot that encourages verbalization by asking questions.
/nishio/kei.iconWhat kind of question?
/nishio/human.iconThe original Keichobot behaves according to a coaching technique called Clean Language.
/nishio/kei.iconKeichobot is a bot that behaves according to a coaching methodology and can organize the other person's words and approach their inner world through questions.
/nishio/human.icon(esp. of men) one's prime (approx. age 30)
/nishio/kei.iconKeichobot is a question-answering bot that runs on a program and follows a coaching methodology.
/nishio/human.iconThat's right.
/nishio/kei.iconWhat types of questions was Keichobot designed to ask?
/nishio/human.iconThe questions that take out the human mindscape without distorting it are
/nishio/kei.iconCan you elaborate a bit more on the concept you described of "taking out the human mindscape without distorting it"?
/nishio/human.iconWhen a question contains an implicit assumption, the respondent is influenced by it and gives a distorted answer. This is very bad because the respondent may misinterpret it as his/her own idea without realizing that it has been distorted by the question. Therefore, it is necessary to have a technique to extract the information without distorting it.
/nishio/kei.iconCan you give some more specific examples to illustrate the concept you mentioned, that if a question contains implicit assumptions, it will result in a distorted answer?
/nishio/human.iconFor example, "Is it A or B?" I would answer with A or B, even if it is really C.
/nishio/kei.iconWhat is the "C" in regards to?
/nishio/human.iconFor example, the question of whether it is OK or NG creates the misconception that one has to decide "now" which is which, but in reality, the decision can be postponed.
/nishio/kei.iconWhat type of "misunderstanding" did you describe? Can you describe them specifically?
/nishio/human.iconA misconception that makes us think there are only two choices when there are really more.
/nishio/kei.iconIs it important to you to have choices? Do you feel it is of any value to you?
/nishio/human.iconIt is important to have choices. It is valuable. Too many and you won't be able to decide, but until you do, it's better to have as many as possible.
/nishio/kei.iconWhat does it mean to you to have a choice? Can you be more specific?
/nishio/human.iconHmmm, that's a tough question.
/nishio/kei.iconWhat is important about "choice?"
/nishio/human.iconI guess I feel like I made my own decision.
/nishio/kei.iconHow do you feel about the feeling of "self-determination?"
/nishio/human.iconIf they succeed after making their own decisions, it makes them feel that they have succeeded and increases their sense of self-affirmation. Conversely, a child who takes the college entrance exam as told by his or her parents and passes the exam may go crazy because he or she does not have a sense of self-affirmation.
/nishio/kei.iconWhat kind of self is "me"?
/nishio/human.iconThe self that proactively chooses to live his or her own life.
/nishio/kei.iconIs there anything else about yourself that you feel is important?
/nishio/human.iconI think it's about being able to say, "I lived life proactively" when you die. It is easy to understand if you consider the opposite extreme. If you think, "I just followed my parents' orders all my life," you will feel like a robot.
/nishio/kei.iconWhat exactly is the "bot" you are talking about?
/nishio/human.iconAn entity that can only move according to orders.
/nishio/kei.iconWhat exactly would an "order" look like?
/nishio/human.iconTaking away the opportunity for proactive decision-making.
/nishio/kei.iconWhat exactly do you mean by "decision making" when you state "taking away the opportunity for proactive decision making"?
/nishio/human.iconDecide for yourself what actions you will take.
/nishio/kei.iconWhere do you come from with regard to the "self" you described as "deciding for oneself what actions one performs"?
/nishio/human.iconIt's there when you realize it's there.
/nishio/kei.iconCan you tell us a little more about "chi"?
/nishio/human.iconWhen you are aware of your existence, you already exist.
/nishio/kei.iconWho exactly do you mean by "yourself"?
/nishio/human.iconHuman beings in general, not referring to any specific person here.
/nishio/kei.iconWhat exactly do you mean by "choices"?
/nishio/human.iconIts human behavioral options.
/nishio/kei.iconHow do you know what the alternatives are?
/nishio/human.iconSometimes we happen to know, and sometimes we actively take action to know. Back to the story, depending on how the question is asked, it can encourage the discovery of alternatives or, conversely, make them invisible, so a questioner without malicious intent is beneficial
/nishio/kei.iconWhat do you think is the best way for the person to find options for action?
/nishio/human.iconBasically, I'd prefer more information-gathering action.
/nishio/kei.iconWhat types of "actions" can the person take to discover behavioral options?
/nishio/human.iconFor example, attending events, meeting new people, going to schools, etc. to gain new knowledge, joining new communities, etc.
/nishio/kei.iconOne of the other ways to increase your options for action is to increase your output. This includes writing down your thoughts and talking about them.
/nishio/human.iconthat's so, isn't it
/nishio/kei.iconIt is desirable for the person to discover more options for action.
/nishio/human.iconThat's right.
/nishio/kei.iconBy "action," what exactly do you mean?
/nishio/human.iconWhat the specific action is depends on the situation. For example, I often consult with Keichobot about development, and in this case, "implementation" is the action. In this case, "implementation" is the action. There are several methods of implementation, or there are several objectives, and I am not sure which one should be prioritized.
/nishio/kei.icon'Consulting Keichobot' is an 'implementation' action, but where are you actually taking that action?
/nishio/human.iconThe implementation is done in front of a computer.
/nishio/kei.iconCould you be more specific about "implementation?" For example, what kind of programs are you implementing?
/nishio/human.iconSometimes it depends on the Keichobot itself.
/nishio/kei.iconHow is Keichobot actually developed?
/nishio/human.iconI'm running it on heroku right now.
/nishio/kei.iconHow did you gather information to learn about Keichobot?
Summary so far
[Test chat log summary
- Test the chat log summary feature.
- The original Keichobot behaves according to clean language.
- With ChatGPT, even subtle questions are returned repeatedly.
- Even human counselors can be asked subtle questions.
- Depending on how the questions are asked, they can encourage the discovery of alternatives.
- It is important to increase action.
- Some actions for implementation, depending on the situation.
- Keichobot has its own implementation.
- It is running on Heroku.
[Next action.
- Make it work on Scrapbox.
/nishio/human.iconThe summary function worked. I think I can run it on Heroku.
/nishio/kei.iconCan you tell us what Scrapbox is all about?
/nishio/human.iconA very easy-to-use, knowledge-storing mechanism
/nishio/kei.iconWhat do you need to do to know its behavior?
/nishio/human.icon？
/nishio/kei.iconWhat needs to be improved regarding "Keichobot itself?"
/nishio/human.iconWe are currently in the process of exploring the direction of combining Keichobot and GPT. If we decide to make the transition in earnest, I think it would be better to take this opportunity to rework many parts of the existing algorithm that we don't need.
/nishio/kei.iconWhat do you think needs to be improved about Keichobot?
/nishio/human.iconI think it would be better to let LLM do the machine learning on its own.
/nishio/kei.iconCan you elaborate on what you can do?
/nishio/human.iconThe keywords are scored using machine learning to determine which questions are appropriate. Replace there.
/nishio/kei.iconWhat kind of output would you like to see emerge from the "question"?
/nishio/human.iconIt is good if the user speaks with enthusiasm. We are now doing our own machine learning to determine this enthusiasm.
/nishio/kei.iconWhat kind of enthusiasm would you like to see as your desired output?
/nishio/human.iconIt is desirable to get the user into a state of immersion and a lot of talking. New discoveries can be made from what is said in this way.
/nishio/kei.iconWhat kind of enthusiasm would you like to see as your desired output with respect to "The Question?"
/nishio/human.iconIt would be nice to have a situation where words start pouring out in response to questions asked, and more and more verbalization occurs without the user having to work hard at it.
/nishio/kei.iconWho exactly do you mean by "users"?
/nishio/human.iconMe first, then anyone who is interested and wants to use it.
/nishio/kei.iconWhat is the "Keichobot" program?
/nishio/human.iconA program that encourages such people to go further and further ahead by asking them questions and encouraging them to verbalize their Next Actions.
/nishio/kei.iconCan you explain exactly how you would pose the question?
/nishio/human.iconRight now I'm throwing the whole mess to LLM, but it's not very good, so I guess I'll have to break it up into steps to execute it.
/nishio/kei.iconIf Keichobot is executed in steps, what are the specific steps?
/nishio/human.iconThat's not enough experimentation yet, and it's hard to try it while tinkering with a system running on a server, better to create an experimental environment with local scripts.
/nishio/kei.iconWhat was the purpose of Keichobot?
/nishio/human.iconThe effect of encouraging clean language verbalization is very impressive, but it is too expensive to make an appointment with a human for coaching, so it is worthwhile to allow a machine to do it, even if it is somewhat less capable than a human.
/nishio/kei.iconWhat exactly do you mean by "verbalization?"
/nishio/human.iconTo be able to put into words and explain matters that I cannot yet explain well.
/nishio/kei.iconTo begin with, who is Keichobot?
/nishio/human.iconIt would be digital stationery.
/nishio/kei.iconThe relationship between "Keichobot" and "questions" is that Keichobot poses questions to users, encouraging them to deepen and verbalize their own thoughts.
/nishio/human.iconYes.
/nishio/kei.iconHow do you expect Keichobot to change the way "users" think?
/nishio/human.iconIf you cannot verbalize your thoughts, you cannot look them over. Verbalization is the first step in being able to critically examine your thoughts and find solutions to the contradictions and problems you are struggling with.
/nishio/kei.iconIt would be nice if "users" could deepen their own thinking and verbalize their ideas so that they can examine them more critically and find solutions to conflicting problems, but what else do you expect?
/nishio/human.iconIf you can verbalize it, others and your future self can read it. Ideas in your brain disappear quickly.
/nishio/kei.iconDo you expect anything specific to happen to "you"?
/nishio/human.iconI expect realizations to happen.
/nishio/kei.iconI can tell you that after the verbalization happens, you will have a clearer picture of what is important to you, but do you expect it to lead to any specific actions?"
/nishio/human.iconClarity of what is important changes the priorities of resource allocation, which in turn allocates those resources to actions that were not previously allocated mindshare, time, or money, and they begin to move.
/nishio/kei.iconWhat specific "actions" do you take once you realize what is important?
/nishio/human.iconActions are created to achieve what you think is important.
/nishio/kei.iconWe hope that their actions will lead to concrete steps to solve problems and issues.
/nishio/human.icon(esp. of men) one's prime (approx. age 30)
/nishio/kei.iconDo you think that this verbalization can be more useful to others and to your future self than to yourself?
/nishio/human.iconOf course I think there is.
/nishio/kei.iconIs this self the conscious self that exists in the brain? Or is it a physical self?
/nishio/human.iconA curious question. Since consciousness alone would not be able to act, it is the physical self in the sense that it is the subject that acts. It could be said that the physical self acts according to a course of action verbalized by the conscious self.
/nishio/kei.iconWe can think of this as a link between verbalization and action, which changes the priorities for resource allocation, allocates resources to previously unallocated actions, and creates movement.
/nishio/human.iconThat's right.
/nishio/kei.iconAs verbalization leads to action, the priorities for resource allocation will change and resources will be allocated to previously unallocated actions, creating a movement that is eagerly awaited.
/nishio/human.iconYes, ask any questions.
/nishio/kei.iconVerbalization allows you to clearly understand your thoughts and feelings and thereby grasp the values and goals you hold dear.
/nishio/human.iconQuestion.
/nishio/kei.iconI think "verbalization" can be very useful to understand one's inner life clearly, but what does it mean to you?
/nishio/human.iconIf you have a clear understanding of your inner self, you can live better
/nishio/kei.iconThe "self" refers to the self as a being that understands its own inner self and values and is better able to lead a better life.
/nishio/human.iconThat's a good summary.
/nishio/kei.iconDo you think there is a connection to Keichobot, a clean language designed to provide choice?
/nishio/human.iconClean Language is not designed to provide choice.
/nishio/kei.iconAre the "options" drawn from your self-narrative?
/nishio/human.iconthat's so, isn't it
/nishio/kei.iconSo what do you think is the purpose for which Clean Language was designed?
/nishio/human.iconIt's about drawing them out.
/nishio/kei.iconThe purpose of "clean language" is to perceive information for the purpose of explaining it.
/nishio/human.iconHmmm, well, yes. You could say that the goal is to make the client perceive it clearly so that he/she can explain his/her feelings and thoughts to others. Maybe the related symbolic modeling is clearer on the idea there.
/nishio/kei.iconBy "others," what kind of people are you referring to?
/nishio/human.iconOther than yourself
/nishio/kei.iconWhat characteristics does he/she have?
/nishio/human.iconYou can't know what's in your heart without describing it in words.
/nishio/kei.iconWhat do you mean by "the word?"
The limits of ChatGPT memory. Summary so far
- The chit-chat evolves from the topic of testing a chatbot with the ability to automatically return a summary of chat logs.
- Asking the right questions can put the inner human being into words.
- The importance of enabling clients to explain their own feelings and thoughts to others in words was raised as an objective to make them perceive them clearly.
- Clean Language is not intended to provide choices, but it does play a role in the related symbolic modeling.
- Keichobot and ChatGPT must be combined, starting with experiments in local environments.
- FUTURE WORK: Development of a combination of Keichobot and ChatGPT will be promoted.
---
This page is auto-translated from /nishio/Keichobot自動要約機能 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.